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LISTING OF CLAIMS: 



1. (Original) An image analysis and conversion method 

comprising: 

receiving a digital ink image; and 

converting the digital ink image into structured object representations of 
the digital ink image, which are editable by a structured text/graphics editor. 

2. (Original) The method according to claim 1 wherein the 
converting step includes, 

altering the digital ink image into multiple alternative interpretations. 

3. (Original) The method according to claim 2 wherein the altering 
of the digital ink image into multiple alternative interpretations includes, 

altering the digital ink image into informal structured object representations 
that are editable by the structured text/graphics editor; and 
i altering the digital ink image into formal structured object representations 

I \ that are editable by the structured text/graphics editor. 
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4. (Original) The method according to claim 1 wherein the step of 
converting the digital ink image into structured object representations of the digital ink 
image includes configuring the structured object representations to represent an 
electronic slide of the structured text/graphics editor. 

5. (Original) The method according to claim 1, wherein the 
converting step includes forming of an Alternative graph. 

6. (Original) The method according to claim 5 wherein forming of 
an Alternative Graph includes: 

forming for each of a number of closed curvilinear paths, a first 
intermediate data structure, and placing in the first intermediate data structure a list of 
alternative interpretations of the closed curvilinear paths; 
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forming for each of a number of open curvilinear paths, a second 
intermediate structure, and placing in the second intermediate data structure a list of 
alternative interpretations of the open paths; 

forming for text of a number of text groups, a third intermediate data 
structure, and placing in the third intermediate data structure, a list of alternative 
interpretations of the text; 

determining spatial containment relations, for each intermediate data 
structure representing the closed curvilinear paths; 

testing all other intermediate data structures and determining whether an 
object is spatially contained within the bounds of each of the closed curvilinear paths 
and, if so, denoting this relation in a contained-by slot of the intermediate data structure; 

selecting all structures for which a contained-by slot of the intermediate 
data structures is empty; 

creating an Alternative node for the Alternative Graph for each 
intermediate data structure for which the contained-by slot is empty; and 

for each Alternative node, performing the steps of, 

traversing a collection of objects related to the Alternative node, 

counting at each intermediate data structure encountered a number of 
alternative interpretations of the objects, 

defining, as N, a maximum of this count over all descendents of the 
Alternative node, 

creating N nodes of a type, CHOICE, 

linking the CHOICE type nodes to the Alternative node, and 
constructing, for each choice branch of the Alternative node, a tree of 
descendent and nested objects. 



converting the digital ink image to the structured object representations includes 
generating multiple structured object representations of the digital ink image, the 
multiple structured object representations representing at least a first image 
representation having formal structured object representations, and a second image 
representation containing informal structured object representations. 
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(Original) 



The method according to claim 1 wherein the step of 
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8. (Original) The method according to claim 1 wherein the editing 
by the structured text/graphics editor permits movement of structured object 
representations by at least one of, individual objects, a sub-group of all the structured 
object representations, or as an overall group of the structured object representations. 

9. (Original) The method according to claim 1 wherein the digital 
ink image is converted into the structured objects representations of the digital ink 
image through the use of an Alternative Graph. 

1 0. (Original) The method according to claim 9 wherein forming of 
an Alternative Graph includes: 

forming for each of a number of closed curvilinear paths, a first 
intermediate data structure, and placing in the first intermediate data structure a list of 
alternative interpretations of the closed curvilinear paths; 

forming for each of a number of open curvilinear paths, a second 
intermediate structure, and placing in the second intermediate data structure a list of 
alternative interpretations of the open paths; 

forming for text of a number of text groups, a third intermediate data 
structure, and placing in the third intermediate data structure, a list of alternative 
interpretations of the text; 

determining spatial containment relations, for each intermediate data 
structure representing the closed curvilinear paths; 

testing all other intermediate data structures and determining whether an 
object is spatially contained within the bounds of each of the closed curvilinear paths 
and, if so, denoting this relation in a contained-by slot of the intermediate data structure; 

selecting all structures for which a contained-by slot of the intermediate 
data structures is empty; 

creating an Alternative node for the Alternative Graph for each 
intermediate data structure for which the contained-by slot is empty; and 

for each Alternative node, performing the steps of, 

traversing a collection of objects related to the Alternative node, 

counting at each intermediate data structure encountered a number of 
alternative interpretations of the objects, 
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defining, as N, a maximum of this count over all descendents of the 
Alternative node, 

creating N nodes of a type, CHOICE, 

linking the CHOICE type nodes to the Alternative node, and 
constructing, for each choice branch of the Alternative node, a tree of 
descendent and nested objects. 

1 1 . (Original) An image analysis and conversion system comprising: 
an image receiving input designed to receive a digital ink image; and 

a converter configured to convert the digital ink image into structured 
object representations of the digital ink image which are editable by a structured 
text/graphics editor. 

12. (Original) The system according to claim 1 1 wherein when the 
converter converts the digital ink image to the structured object representations of the 
digital ink image, the structured object representations are in the form of at least one of 
formal structured objects and informal structured objects. 

1 3. (Original) The image analysis and conversion system according 
to claim 12 wherein the converter includes, 

an image processing and segmentation module, which identifies classes 
of primitive image objects, including at least one of (i) small connected components at 
the scale of text characters, and (ii) substantially straight curvilinear line fragments 
uncomplicated by junctions, called stroke-fragments; 

a text identification and layout analysis module which identifies groupings 
of the stroke objects representing runs of text characters forming text lines and 
columns, to generate a list of text group structures, each containing two or more 
alternative interpretations of the text groups; 

a line art analysis module, which identifies groupings of stroke objects, to 
generate a list of line art group objects, each containing two or more alternative 
interpretations of the line art objects; 

a construction of alternative graph module, which takes as input the lists 
of text and line art groups including alternative interpretations for each group, and 
constructs an Alternative Graph; and 
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an export to structured graphics editor module, which traverses the 
alternative graph and creates presentation slides with text and line art objects, and a 
hierarchy of groups. 

14. (Original) On a screen display of an electronic device operating 
a structured text/graphics editor, an image representation comprising: 

structured object representations of a digital ink image, the structured 
object representations correlating to perceptually salient areas of the digital ink image, 
wherein the structured object representations are editable by the structured 
text/graphics editor to allow a user to generate alternative interpretations of the digital 
ink image. 

15. (Original) The image representation according to claim 14 
wherein the structured object representations are informal structured object 
representations, and wherein the informal structured object representations are editable 
to formal structured object representations. 

16. (Original) The image representation according to claim 15 
wherein the alternative interpretations permit a mixing of formal structured object 
representations and informal structured object representations in a single image 
representation displayed on the computer screen. 

17. (Original) The image representation according to claim 14 
wherein a first structured object representation is spatially contained within a second 
structured object representation. 

18. (Original) The image representation according to claim 14 
wherein a new structured object representation is added to existing structured object 
representations. 

19. (Original) The image representation according to claim 14 
wherein the structured object representations define a text block structure. 




20. (Original) The image representation according to claim 19 
wherein the text block structure includes a display of text parameters including at least 
one of text layout, text font, bullets, underlines and dummy characters. 

21. (Original) The image representation according to claim 20 
wherein the dummy characters are replaceable with target characters. 

22. (Original) The image representation according to claim 14 
wherein distinct alternative interpretations may be displayed at the same time. 

23. (Original) The image representation according to claim 22 
wherein display of the alternative interpretations is accomplished by the use of at least 
one of underlays, bubble or balloon images, coloring, shading 
transparency/translucency, defocusing, and pop-up windows. 
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